Probabilistic Multi-State Split-Merge Algorithm for Coupling Parameter Estimates
نویسنده
چکیده
A new approach to finding good local maxima of the likelihood function based on synthesizing information from two local maxima is presented. We investigate the coupled EM algorithm (CoEM) for coupling local maxima solutions from two separate EM runs for the multinomial mixture model. The CoEM algorithm probabilistically splits and merges multiple latent states based on conditional independence assumptions and is numerically shown to significantly improve on uncoupled EM or deterministic annealing (DAEM) parameter estimates.
منابع مشابه
A New Multi-objective Model for Multi-mode Project Planning with Risk
The purpose of this problem is to choose a set of project activities for crashing, in a way that the expected project time, cost and risk are minimized and the expected quality is maximized. In this problem, each project activity can be performed with a specific executive mode. Each executive mode is characterized with four measures, namely the expected time, cost, quality and risk. In this pap...
متن کاملAn Improved Merge-split Sampler for Conjugate Dirichlet Process Mixture Models
The Gibbs sampler is the standard Markov chain Monte Carlo sampler for drawing samples from the posterior distribution of conjugate Dirichlet process mixture models. Researchers have noticed the Gibbs sampler’s tendency to get stuck in local modes and, thus, poorly explore the posterior distribution. Jain and Neal (2004) proposed a merge-split sampler in which a naive random split is sweetened ...
متن کاملNBCT: A Toolkit for Naive Bayes Clustering
3 Clustering algorithms 5 3.1 ML/MAP based clustering . . . . . . . . . . . . . . 5 3.1.1 Parameter estimation based on ML . . . . . . 5 3.1.2 Parameter estimation based on MAP . . . . . 5 3.1.3 Membership distribution . . . . . . . . . . . 6 3.1.4 Dissimilarity . . . . . . . . . . . . . . . . . 7 3.1.5 Clustering . . . . . . . . . . . . . . . . . . . 7 3.1.6 Relevance analysis . . . . . . . . ...
متن کاملSplit and Merge EM Algorithm for Improving Gaussian Mixture Density Estimates
The EM algorithm for Gaussian mixture models often gets caught in local maxima of the likelihood which involve having too many Gaussians in one part of the space and too few in another, widely separated part of the space. We present a new EM algorithm which performs split and merge operations on the Gaussians to escape from these configurations. This algorithm uses two novel criteria for effici...
متن کاملBlock Based Image Segmentation
Image segmentation is an important research field due increasing Internet and computer based applications and also for video coding but it is very challenging. There exist a huge number of algorithms for image segmentation using split and merge having some limitations for which pattern based object segmentation using split and merge (PSM) was proposed to overcome the problems of basic split and...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2006